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DETAILED ACTION 

The following office action is in response to the amendment filed on June 26, 2006. Claims 2, 4- 
7, 10, 22-25, 27 and 28 are pending. Claims 2, 4, 22, 24 and 28 are amended. Claims 3, 8, 9, 12- 
20, 23 and 26 have been cancelled 

Claim Rejections - 35 USC §103 

1. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

2. Claims 2, 4,10, 22, 24, 27 and 28 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Chang et al (US 6,285,351) in view of Thomer et al (6,422,941). 

With regard to claim 2, Chang et al teaches a method (SEE Chang et al. title 
''DESIGNING FORCE SENSATIONS FOR COMPUTER APPLICATIONS INCLUDING 
SOUNDS" abstract and figure 1 ), comprising: storing a portion of sound data in a memory 
buffer of a computer (SEE Chang et al. figure 1, shows a "HOST COMPUTER SYSTEM" that 
has an audio output for games, and column 3, lines 15-23, see "list" of sounds, wherein it is 
inherent that the computer stores sound data in a memory ), analyzing the portion of sound data 
using to identify at least one sound feature from the portion of sound data (SEE Chang et al. 
column 3, lines 15-22 and figure 8, item 512, column 15, lines 65-67), and executing at least one 
haptic effect based on the one or more sound features the haptic effect being associated with the 
portion of sound data (SEE Chang et al. column 2, lines 29-67, column 3, hnes 1-40 and colunm 
15, lines 1-39). 
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Chang et al. does not illustrate, dividing the portion of sound data into a plurality of 
frequency ranges and analyzing each frequency range to determine one or more sound features 
corresponding to at least one of the frequency ranges. However Thomer et al. shows a 
"Universal Tactile Feedback System for Computer Video Games and Simulations" which 
teaches, the analyzing including identifying at least one frequency component of a sound feature, 
the at least one frequency component being from a first frequency range" (SEE Thomer et al. 
figure 1, items 100, 102, 103, 1 12, figure 3, items 310,330, figure 4, items 430, 440, 450, 340, 
figure 11, items 1 1 10, 1 120, and 1 130, column 2, lines 52-65), column 8, lines 57-66, Col. 9, 
lines 53-67, column 11, lines 17-40). It would have been obvious to one of ordinary skill in the 
art at the time the invention was made to modify the Chang et al. apparatus to have the above 
features as taught by Thomer et al. because Chang et al. indirectly suggest it in column 15, line 
32-39, where he states; "In alternate embodiments, different methods can be used to assign 
sounds. For example, a sound might be assigned directly to a force sensation (or vice-versa). 
Whenever the force sensation is output, the associated sound is also output." This vice-versa 
language is clearly suggestive of the feature whenever the sound is output, the associated force 
sensation is also output. Since Chang et al. lacks the details as to how to automatically recognize 
a specific sound from a game as taught by Thomer et al. Chang et al. would have been motivated 
to use the well known Thomer et al. method of analyzing the frequency of the soimd. The 
modifications provided by Thomer et al. al. would give the Chang et al. apparatus more utility 
because Thomer et al. provides a Host independent section that facihtates the playing of old 
games that had sound but no force feedback whereby because of its ability to recognize the game 
sounds it enhances the game with force feedback. 
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With regard to claim 10 the combination of Chang et al. and Thomer et al. teaches the 
method of claim 2, wherein the at least one haptic effect was previously mapped to the at least 
one sound feature (SEE Chang et al. column 15, lines 20-24 and 32-38). 

With regard to claim 4 the combination of Chang et al. and Thomer et al. was shown in 
claim 1 above to read on most of the limitations of claim 4 in addition the combination of Chang 
et al. and Thomer et al. teaches wherein the portion of sound is divided into a plurality of 
frequency ranges by applying a plurality of filters to the portion of sound data ( SEE Thomer et 
al. figure 4, item 430 =BASS AUDIO FILTER", item 440 "MIDRANGE AUDIO FILTER" 450 
"TREBBLE AUDIO FILTER" ), and identifying a sound feature associated with at least one 
frequency component from the plurality of frequency components (SEE Thomer et al. figure 4, 
item 340 and figure 12 BASS AUDIO ANALYSIS" ). 

With regard to claim 5 the combination of Chang et al. and Thomer et al teaches the 
method of claim 4, the plurality of filters having at least: a low-pass filter; and a high-pass filter 
(see Thomer et al. figure 4, item s 430 and 450 ). 

With regard to claim 8 the combination of Chang et al. and Thomer et al. teaches the 
method of claim 4, wherein the at least one frequency component is each associated with a haptic 
effect related to the frequency range associated with the at least one frequency component ( SEE 
Thorner et al. figure 12). 

With regard to claim 9 the combination of Chang et al. and Thomer et al. teaches the 
method of claim 4, wherein the at least one frequency component is each uniquely associated 
with a periodic haptic effect having a frequency corresponding to the plurality of fi-equency 
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ranges associated with the at least one frequency component (SEE Thomer et al. figure 1 1 and 
also SEE Chang et al. lines 15-22 "periodic"). 

With regard to claim 12 the combination of Chang et al. and Thomer et al. was shown in 
claims 1 and 4 above to read on most of the limitations of claim 12 in addition the combination 
of Chang et al. and Thomer et al. teaches the sound feature and haptic effect are characterized as 
being high-level (this recitation as to the relative level of importance of a sound or haptic effect 
such as being high is best directed towards an obvious intended use of the combination of Chang 
et al. and Thomer et al. because it is obvious that there would be a level of importance assigned 
to sounds in order for the program to know what to do when it hears two or more sounds at the 
same time). 

With regard to claim 13 the combination of Chang et al. and Thomer et al. teaches the 
method of claim 12, wherein the at least one high level haptic effect is associated with the at 
least one frequency component (SEE Thomer et al. figure 12 ). 

With regard to claim 19 the combination of Chang et al. and Thomer et al. teaches the 
method of claim 12, wherein the least one high-level haptic effect is executed as a haptic 
sensation output by a haptic feedback device (SEE Chang et al. column 15, lines 32-38 and also 
SEE Thomer et al. figure 1, item 120). 

With regard to claim 20 the combination of Chang et al. and Thomer et al. teaches the 
method of claim 12 wherein the at least one high-level haptic effect is stored in memory of the 
computer as a created haptic effect (SEE Chang et al figure 8, items 510 and 511). 

With regard to claim 14 the combination of Chang et al. and Thomer et al. was shown in 
claims 1,4, and 12 above to read on most of the limitations of claim 14, in addition the 
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combination of Chang at al. and Thomer at al. teaches, "the analyzing including separating the 
portion of sound data into a plurality of frequency components associated with a plurality of 
frequency ranges by applying a plurality of filters to the portion of sound data( SEE Thomer at 
al. figure 4, item 430 "BASS AUDIO FILTER", item 440 "MIDRANGE AUDIO FILTER" 450 
"TREBBLE AUDIO FILTER" ), and identifying a sound feature associated with at least one 
fi-equency component from the plurality of frequency components (SEE Thomer et al. figure 4, 
item 340 and figure 12 "BASS AUDIO ANALYSIS" ). 

With regard to claim 17 the combination of Chang et al. and Thomer et al. teaches the 
method of claim 14, wherein the at least one firequency component is each associated with a 
haptic effect related to the frequency range associated with the plurality of frequency 
components (SEE Thomer et al. figure 12 ). 

With regard to claim 18 the combination of Chang et al. and Thomer et al teaches the 
method of claim 1.4, wherein the at least one frequency component is each uniquely associated 
with a periodic haptic effect having a frequency corresponding to the plurality of frequency 
ranges associated with the at least one frequency component (SEE Thomer et al. figure 1 1 and 
also SEE Chang et al. lines 15-22 "periodic"). 

With regard to claim 22 the combination of Chang et al. and Thomer et al. was shown in 
claims 1,4, 12 and 14 above to read on most of the limitations of claim 22, in addition the 
combination of Chang et al. and Thomer et al. teaches, teaches a computer readable medium 
having code stored thereon (SEE Thomer et al. figure 2, item 102 and also figure 3, items 342 
and 344). 
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With regard to claim 23 the combination of Chang et al and Thomer et al teaches the 
computer readable medium of claim 22, wherein at least one haptic effect is associated with the 
at least one frequency component ( SEE Thomer et al. figure 12). 

With regard to claim 27 the combination of Chang et al. Thomer et al. teaches the 
computer readable medium of claim 22 wherein the at least one haptic effect was previously 
mapped to the at least one sound feature (SEE Chang et al. column 15, lines 20-24 and 32-38). 

With regard to claim 24 the combination of Chang et al. and Thomer et al. was shown in 
claims 1,4, 12, 14 and 22 above to read on most of the limitations of claim 24, in addition the 
combination of Chang et al. and Thomer et al. teaches, the code to analyze including code to 
separate the portion of sound data into a plurality of frequency components associated with a 
plurality of frequency ranges by applying a plurality of filters to the portion of sound data (SEE 
Thomer et al. figure 4, item 430 "BASS AUDIO FILTER', item 440 "MIDRANGE AUDIO 
FILTER" 450 =TREBBLE AUDIO FILTER" ), and code to identify a sound feature associated 
with at least one frequency component from the plurality of frequency components (SEE 
Thomer et al. figure 4, item 340 and figure 12 =BASS AUDIO ANALYSIS" ). 

With regard to claim 28 the combination of Chang et al. and Thomer et al. was shown in 
claims 1,4, 12, 14 and 22 above to read on most of the limitations of claim 24, in addition the 
combination of Chang et al. and Thomer et al teaches, an apparatus, comprising: the means for 
analyzing being configured to identify at least one frequency component of a sound feature, the 
at least one frequency component being from a first frequency range ((SEE Thomer et al. figure 
1, items 100, 102, 103, 112, figure 3, items 310, 330, figure 4, items 430, 440, 450, 340, figure 
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11, items 1110, 1120, and 1130, column 2, lines 52-65), column 8, lines 57-66, column 9, 
lines 53-67, column 11, lines 17-40). 

3. Claims 6, 7 and 25 are rejected under 35 U.S.C. 103(a) as being unpatentable over Chang 
et al in view of Thomer et al as applied to claims 2 and 24, above and further in view of Fineberg 
(US 5,842,163). 

With regard to claims 6, 7, and 25 the combination of Chang et al. and Thomer et al. does 
not illustrate, the analyzing including: separating the portion of sound data into a plurality of 
frequency components associated with a plurality of frequency ranges using a fast Fourier 
transform (FFT), wherein a number of outputs from the fast Fourier transform are grouped to 
provide sound features associated with each frequency range from, the plurality of frequency 
ranges". Thomer et al. instead performs separating the portion of sound data into a plurality of 
frequency components associated with a plurality of frequency ranges using a treble, midrange 
and bass audio filters. Note in column 8, lines 53-56 Thomer et al. states this section serves to 
filter and separate the audio signal into one or more filtered audio signals that are more amenable 
to manipulation by the micro controller 320. and then states in column 8, lines 57-64; ==The 
analog audio signals leaving pre-processing section 310 are then sampled by analog-to-digital 
converters (ADCs) 330 to produce digital signals that are processed and analyzed by the 
processor 340 to generate the control signals for the tactile sensation generators. The processing 
of the audio signals are generally performed under the control of the micro controller 320 using 
the appropriate software application residing in the ROM 344." Therefore there is a clear 
suggestion to use an "appropriate software application" to perform the processing of the sound 
data, but there was little detail given therefore it is essential we use a processing method well 
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known in the art for proper implementation of the combination of Chang et al. and Thomer et al. 
It is obvious that the well known text book mathematical process of using a fast Fourier 
transform (FFT) to convert the input sound time function into a frequency (power) spectrum 
would have been used. Fineberg teaches ^method for recognizing a sampled sound signal in 
noise'* (title), where 'and a minimum and maximum feature value for each frequency band" 
(figure 2, item 220) and determine power spectrum values for each pre-emphasized sampled 
sound signal" (figure 3) and see figure 4 "a representation of a power spectrum of a sampled 
sound signal with frequency filters imposed thereon" and fiirther Fineberg states in column 3, 
lines 34-54; "The pre-emphasized sound signal samples for each analysis frame are band pass 
filtered by a series of filters covering different frequency bands. The filters may be applied in 
any computational manner desired in either the time domain or the frequency domain. Li the 
preferred embodiment, the filters are applied in the frequency domain. First, however, a power 
spectrum of the pre-emphasized sound signal samples in the analysis frames must be computed 
(320 of FIG. 3). The power spectrum is found by: 

a. The pre-emphasized sound signal samples in the analysis frame are multipUed by 
samples of a window function, or weighting function. Any window fixnction may be applied. For 
purposes of explaining the present invention, a simple rectangular window is assumed (the 
window has a value of 1 .0 for all samples). 

b. The Fourier Transform of the pre-emphasized sound signal samples in each 
windowed analysis frame is computed. 

c. Values for the power spectrum are obtained by squaring the Fourier Transform 
values." 



Application/Control Number: 09/974,759 Page 10 

Art Unit: 2629 

It would have been obvious to one of ordinary skill in the art at the time the invention 
v^as made to further modify the combination Chang et al. and Thomer et al. apparatus to the use 
the processing method taught by Fineberg because as stated above Thomer et al. indirectly 
suggested it and Fineberg gave the motivation needed for using his processor for example he 
stated in column 1, line 13-15 "to sound recognition in a high or variable noise environment". 

Response to Arguments 
4. Applicant's arguments filed June 26, 2006 have been fully considered but they are not 
persuasive. 

Applicant argues where the prior art of record fail to disclose dividing the portion of 
sound data into a plurality of frequency ranges and analyzing each range. Examiner, 
respectfully, disagrees. Thomer discloses a "Universal Tactile Feedback System for Computer 
Video Games and Simulations" which teaches, the dividing of the sound data into a plurality of 
frequency ranges and the analyzing including identifying at least one frequency component of a 
sound feature, the at least one frequency component being from a first frequency range" (SEE 
Thomer et al. figure 1, items 100, 102, 103, 1 12, figure 3, items 310,330, figure 4, items 430, 
440, 450, 340, figure 11, items 1 1 10, 1 120, and 1 130, column 2, lines 52-65), column 8, lines 
57-66, Col. 9, lines 53-67, column 1 1, lines 17-40). 

Applicant argues where Thomer does not teach haptic effects. The primary reference of 
Chang et al teach executing at least one haptic effect based on the one or more sound features the 
haptic effect being associated with the portion of sound data (SEE Chang et al. column 2, lines 
29-67, column 3, lines 1-40 and column 15, lines 1-39). 
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Applicant argues where the combination of Chang et al and Thomer is inappropriate. 
Examiner, respectfully, disagrees. It would have been obvious to one of ordinary skill in the art 
at the time the invention was made to modify the Chang et al. apparatus to have the above 
features as taught by Thomer et al. because Chang et al. indirectly suggest it in column 15, line 
32-39, where he states; "In alternate embodiments, different methods can be used to assign 
sounds. For example, a sound might be assigned directly to a force sensation (or vice-versa). 
Whenever the force sensation is output, the associated sound is also output." This vice-versa 
language is clearly suggestive of the feature whenever the sound is output, the associated force 
sensation is also output. Since Chang et al. lacks the details as to how to automatically recognize 
a specific sound from a game as taught by Thomer et al. Chang et al. would have been motivated 
to use the well known Thomer et al. method of analyzing the frequency of the sound. The 
modifications provided by Thomer et al. al. would give the Chang et al. apparatus more utility 
because Thomer et al. provides a Host independent section that facilitates the playing of old 
games that had sound but no force feedback whereby because of its ability to recognize the game 
sounds it enhances the game with force feedback. Therefore, the limitations set forth by the 
instant application are taught by the combination of Chang in view of Thomer in view Fineberg. 
Thus, the rejection is maintained and made FINAL. 
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Conclusion 

5. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated fi"om the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Srilakshmi K. Kumar whose telephone number is 571 272 7769. 
The examiner can normally be reached on 9:00 am to 5:30 pm. 

If attempts to reach the examiner by telephone are unsuccessfiil, the examiner's 
supervisor, Sumati Lefkowitz can be reached on 571 272 3638. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent . 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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